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Abstract 

The Hopfield neural networks and the holographic neural networks are models which 
were successfully simulated on conventional computers. Starting with these models, 
an analogous fundamental quantum information processing system is developed in this 
article. Neuro-quantum interaction can regulate the "collapse" -readout of quantum 
computation results. This paper is a comprehensive introduction into associative pro- 
cessing and memory-storage in quantum-physical framework. 

PACS 03.67.Lx, 75.10.Nr, 89.70,+c, 03.65.Bz 

KEYWORDS: 

quantum, neural networks, information processing, pattern recognition, holography 
1. INTRODUCTION 

The aim of this paper is to provide a general introduction and a short coherent overview 
of recent research of quantum Hopfield-like information processing — to show quantum 
information theorists where they have common issues with neural-net modelers. 

In Perus (1996, 1997, 1998) it was systematically presented how and where the math- 
ematical formalism of associative neural network models (Hopfield, 1982; Amit, 1989) and 
synergetic computers (Haken, 1991) is analogous to the mathematical formalism of quantum 
theory. In this paper some of these analogies will be used in an original presentation of 
some information processing capabilities of quantum systems in nature - i.e., not in artificial 
devices, although the latter option is also open. In parallel to ours, two interesting models 
of artificial quantum neural networks have been independently developed by Bonnell and 
Papini (1997) and by Zak and Williams (1998). 

This contribution attempts to describe one of the simplest, but fundamental, quantum 
Hopfield-like information processing "algorithms". We have chosen this "algorithm", simple 
but nevertheless effective, technically realizable and biophysically plausible enough (Pribram, 
1991, 1993), as a convenient one for presenting neural-network-like quantum information dy- 
namics. By saying Hopfield-like we mean a system that is based on the Hopfield model of 
neural nets or spin glass systems, respectively (Dotsenko, 1994; Geszti, 1990). The Hopfield 
" algorithm" has been extensively tested by our computer simulations using various concrete 
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data sets (Perus, 2002; Perus and Ecimovic, 1998; Haykin, 1994). Among others, we have 
effectively realized parallel-distributed content-addressable memory, selective associative re- 
construction or recognition of patterns memorized in a compressed form, and even some 
limited capability for predictions based on a learned data set. We have analyzed how the 
results are dependent on the correlation structure of a specific set of input patterns, and 
conditions for successful processing (Perus, 2002; see also Perus and Dey, 2000). 



2. ASSOCIATIVE NEURAL NET MODEL 

In the Hopfield associative network model, emergent collective computation or learning is 
globally regulated by minimization of the spin-glass-like Hamiltonian energy function (Amit, 
1989; Dotsenko, 1994) 

j JV JV ^ N N P 

H = -9 EE JijQiQj = -oEEE rfvj^Qj (i)- 
z 1=1 j=l z 1=1 j=l k=l 

qi is the actual activity of the i th neuron. There are N neurons in the network: q = 
(qi, qn). v\ is the activity of the neuron % when taking part in encoding the k th memory 
pattern (k is pattern's superscript index). The process of gradient- descent of energy function 
(1) is a result of interactions between the system of neurons, described by q, and the system 
of " synaptic" connections, described by weights Jjj which are elements of the memory matrix 
J (Perus and Ecimovic, 1998). 

In an equivalent, local "interactional" description, the dynamical equation for neuronal 
activities 

N 

qi(t 2 = h + St) = E J H Oifa) or = J q{ti) (2) 

i=l 

is coupled with the Hebb dynamical equation for "synaptic" connections 

J i3 = £ v\ v) or J = E v k (v k f (3). 

k=l k=l 

This system of equations is enough for realizing parallel-distributed information processing 
of input data. It is the core of one of the simplest "algorithms" useful for theoretical brain 
modeling (Amit, 1989) as well as for automatic empirical modeling of concrete experimental 
data sets (Haykin, 1994). 

Input-data vectors v k can be inserted into the system of neurons q iteratively, or can 
be put in the very beginning simultaneously into the Hebb matrix J which contains all 
"synaptic" weights J^- (equation (3)). Let us rewrite the system (2) and (3) into continuous 
description of activities of neurons and synapses at position r and time t: 

q(r 2 , t 2 = h + St) = J J(n, f 2 ) g(fi, dr x (26) 

J(n,r 2 ) = E v\r 1 )v\r 2 ) (3b). 
k=l 

The memory recall is done by q ou tput = ^qinput = J<f'- Variable with a prime means that 
its quantitative value is close to the variable without prime, i.e. q' = q. This can be analyzed 
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by 



q(r 2 ,t 2 ) = J J(n,f 2 ) q'in.h) dr x = J |fj«*(fi) v k (r 2 )^ q'^h) dn 
J v 1 ^) q'i^M) df^j v\r 2 ) + (| v 2 (n) q'^t,) dr^j v 2 (f 2 ) + ... 



+ (/ v P (n) q'i^M) dr^j v p (f 2 ) = 

= A v 1 (f 2 ) + B where A = 1 ('signal'), B = ('noise') (4) 
or in another description 



g (f,t) = ]T C' k (t)v k (r) = E (/ v k (r)q'(f,t)dr) « fc (r) = 

k=l k=l ^ ' 

J v 1 (f)q'(f, t)dr^j v l (r) + ^ v 2 (r)q'(r,t)dr^J v 2 (r) + ... 



+ (^J v p (f)q'(r,t)df^J v p (f) = 

= Av\r) + 5 w/iere A = 1 ('signal'), B = ('noise') (5). 

The first row of equalities in eq. (5) follows, among others, from the neurosynergetic model 
by Haken (1991). In eq. (4) and eq. (5) we had to choose such an input q' that is more 
similar to v 1 , for example, than to any other v k , k ^ 1. At the same time, the input q' should 
be almost orthogonal to all the other v k ,k ^ 1. In this case, q converges to the memory 
pattern-qua-attractor v 1 , as it is shown in the last row of eq. (4) and in the last row of eq. 
(5). Thus, v 1 is recalled. 



3. HOLOGRAPHIC NEURAL NET MODEL 

If we introduce the oscillatory time-evolution of neuronal activities, we get more biologi- 
cally plausible dynamics (Baird, 1990; Schempp, 1994; Haken, 1991; Kapelko and Linkevich, 
1996). Neural net variables then become complex- valued. This is more akin to quantum 
dynamics. However, in quantum theory, complex-valued formalism is essential, but in the 
network of coupled oscillatory neurons complex- valued formalism is just mathematically 
more convenient. 

Simulated holographic neural system by Sutherland (1990) realizes efficient Hopfield-like 
information processing which incorporates oscillatory activities. A Hebb-like "interference" 
of sequences of input -output pairs (indexed by k), each combining an input vector = 
(s\e %6 ^ , s k N e t6 N), i = \/— T, and an output vector o* = (o k e l(p i , o k M e t{p M) ) analogous to 
eq. (3), is made: 

J = £ oV)t J hj = £ s k o k e^-^ (6). 

k=l k=l 

Every J h j encodes a sequence of local input-output amplitude correlations (shOj) and corre- 
sponding phase differences (ip k — 9 k ) in local input and output oscillatory dynamics. Thus, 
the phase differences appear in the elements of the memory matrix J which represents the 
"hologram". If and are defined as two parts of a concatenated vector v k (occupying 



3 



its "upper" and "lower" set of components), then we have the Hebbian "self-interference", 
like in eq. (3). Usually, during learning, inputs and output (indexed by k = 1,...,P) are 
"interfered" in a time sequence - each pair s* and o* corresponds to a discrete time 

A pattern can be reconstructed (analogously to equations (4) or (5)) from the "neural 
hologram" using a recall-key s ': 

N N P 

o> = 3s' <=► £ J hj s' h e^ = EE s\o)e^-^s' h ^ = o)e^ (7). 

h=l h=l k=l 

This is valid if we choose a recall-key that is similar to one of the learned inputs, say s 1 . 
Thus, s' h = s\ and 0' h = 9\, for all h. In such a case, s' h s\ = 1 (if they are normalized) and 
e i8 he -id h _j_ i Other terms (with k ^ 1) are relatively very small ('noise'). (See Sutherland 
(1990) for comprehensive presentation.) 

Holographic associative memories are implemented optically, acoustically, quantum-elect- 
ronically and quantum-biologically (Psaltis et al, 1990; Psaltis and Mok, 1995; Nobili, 1985; 
Schempp, 1994). This supports our view that Hopfield-like associative dynamics with Heb- 
bian learning can be implemented in various (bio)physical (see Jibu et al, 1996) and es- 
pecially quantum systems (Bonnell and Papini, 1997; Zak and Williams, 1998; Nishimori 
and Nonomura, 1996; Ma et al, 1993), including coherent states, quantum dots, quantum 
information channels (Alicki, 1989; Ohya, 1989). Quantum holography (e.g., Abouraddy et 
al, 2001) offers the most natural implementation. 



4. QUANTUM ASSOCIATIVE NET MODEL 

So far, we have discussed the Hopfield-like neural net or spin glass model. Now we will 
present its quantum relative. From the very beginning, let us put attention to the following 
correspondence scheme between the neural (left) and quantum variables (right) means 
"corresponds to"): 

q <^> q' O v k <^> vp k , J^G or J«G, C k <^> c k 

equation (2b) & equation (8), (3b) (9), (4) (10), (5) (11) 

The phase is hidden in the exponent of the wave-function *& which describes the state of 
the quantum system: \I/(r, t) = A(r,t)exp(^if>(r,t)); A is the amplitude. 

The equations in pairs are mathematically equivalent, because the collective dynamics 
in neural and quantum complex systems are similar, in spite of different nature of neurons 
and their connections on one hand, and quantum "points" *ff(r) and their "interactions" 
described by G(fi,f 2 ) on the other. 

The quantum Hopfield-like network model combines the dynamical equation for the quan- 
tum state (Feynman and Hibbs, 1965; Derbes, 1996) 

tt(r 2 ,f 2 ) = / / G(f 1 ,t 1 ,f 2 ,t 2 ) tt(ri,ti) dn dh or tt(t 2 ) = G ^(h) (8) 

and the expression for the parallel-distributed interactive transformation of the quantum 
system (Feynman and Hibbs, 1965) 

G(f 1 ,t 1 ,r 2 ,t 2 ) = f> fc (n,*i)* ^ k (r 2 ,t 2 ) or G(n,f 2 ) = £>*(*)* 4> h (r 2 ) (9). 

k=l k=l 
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Note that expression (9), i.e. for G(vp k (r 1 , ti), ip k (r 2 , t 2 )), presents the kernel of eq. (8) (cf., 
Vapnik, 1998). The system (8) and (9) is just the usual Schrodinger propagation reinter- 
preted for associative processing and measurement-like readout. 

We want to encode some information in eigenfunctions if) k . Then ip k would become quan- 
tum codes of patterns, although not necessarily geometrically isomorphic to some external 
patterns. It may not be possible to encode information in wave-functions or if) k , in the 
same sense (by the same directly decodable way, respectively) that information is encoded 
in neural-net state- vectors q, or v k , for two reasons. First, any natural (non-model) network 
may initially be in some "natural" state, i.e. eigenstate, of its own. Second, q, or v k , are in 
principle directly observable, but or if) k , are (in general) not - not even in principle, as 
long as they remain quantum. Therefore, we act as follows. 

By a classical interaction or perturbation on an appropriate quantum system, we force the 
quantum network into a state \1/ which "implicitly reflects" our external influences (inputs), 
i.e. it is input-modulated. As soon as such a state \I> stabilizes, becoming an eigenstate, 
ifj k (k = 1), we can continue to "insert" (simultaneously or sequentially) other information- 
encoding states (k = 2, ...,p). All these eigenstates ip k interfere as prescribed by equation (9) 
and get thus stored in G. Quantum holography (e.g., Abouraddy et al, 2001) is an example 
which demonstrates how this could be realized, with plane waves ^ — A e^ or wavelets 
(Schempp, 1994), without extensive artificial effords. Moreover, fast-developing specially- 
designed encoding / decoding (measurement) devices (e.g., Weinacht et al, 1999) enable 
enormous additional possibilities. 

Now we want to retrieve a pattern from memory. In our quantum-net model we are not 
interested in like we are not interested in qin our neural-net model. Our final result will 
directly be a single "post-measurement" information-encoding eigenstate tfj k (say k — 1), or 
v k , respectively. We cannot observe \l/ (except in net-simulations by stopping the program) 
and we need not observe \l/ (or q), but we wait until the "measurement" (i.e., pattern-recall 
which is equivalent to the wave-function "collapse") is triggered by our final new input \&' 
or q'. Then, the standard quantum observables O (corresponding to: = Ao - ^), e.g. spin 
states, can reveal the reconstructed pattern-encoding eigenstate if) k (k — 1). Namely, since 
the output is similar to the input (that we know!), the eigenvalue (Ao) information can be 
sufficient for knowing the output. Moreover, if the final \l/ = if> k (k = 1) is / becomes classical 
(like the inputs may well be), then obtaining complete knowledge about the output pattern, 
encoded in if) k (k = 1), is at least in some cases (e.g., optical) relatively straight-forward (e.g., 
like seeing the image reconstructed from a hologram). Beside quantum holography, an al- 
ternative fast-developing technique is quantum tomography for reconstruction of eigenstates 
if) k (D'Ariano et al, 2000). So, our information-processing result can be extracted from if) k 
using new quantum-optical (and computer-aided) techniques for measurement of observables 
or for quantum- holographic- (like) wavefront reconstruction. 

Let's analyze the memory and how a pattern is retrieved from it. Quantum holography 
is our primary suggestion. If eigenfunctions ip k implicitly encode patterns presented to the 
net, then matrix G describes the quantum memory. The propagator expression G in eq. (9), 
which acts as a projector during the pattern-recall (measurement) process, is related to the 
usually-used Green function G (e.g., Bjorken and Drell, 1964/65) by G = —iG. 

If we, in eq. (9) which looks Hebbian, expose the phases ip explicitly, using ^ — A exp(itp), 
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we get an expression which is the quantum ph&se-Hebb learning rule: 

p 



G{n, t u f 2 , t 2 ) = Y, A k (n, ii)M fc (f 2 , t 2 ) e -^.* 2 )-^i.ti)) ( 9& ). 



k=l 



This describes the memory encoding which is two-fold: it is both in amplitude-correlations 
J2k=i^k(r 1 ,t 1 )A k (f 2 ,t 2 ) (Hebb rule) and in phase-differences 8ip k = (p k {r 2 ,t 2 ) - <Pk(n : ti). 

The difference between the rule (9b) and a non-quantum phase-Hebb rule is that in eq. 
(9b) phases tp are quantum phases — i.e., Planck's constant h is hidden in the exponent 
(but the usual notation % — — 1 is used now). 

The quantum memory retrieval {^output — G^') is most-directly realized by the input- 
triggered, non-unitary wave-function "collapse": 

m(r 2 M = ti + 5t) = jG{r 1 ,r 2 )V{r 1 ,t 1 )dr 1 = J ^(n)*^)) *'(ri,*i) ^ = 

= (| ^(ny^in^dn^j ^(f 2 ) + (J i> 2 {n)*V{nM)dr^ 4> 2 (f 2 ) + ... 

+ (/ ^ P (ri)**'(ri,*i)dri) V{f 2 ) = 

= Aip\r 2 ) + B where A = 1 ('signal'), B = {'noise') (fO) 
or in another description 

p p 
q(r,t) = c' k (t)4>\f) = E (/ 4> k (r)*^'(f,t)dr) ^\r) = 

k=l k=l ^ ' 

= ^\r)^'{r,t)dr^ ^(r) + [J ^ 2 (r)*^'(r, t)d?) 4> 2 {r) + ... 

+ ^ P (r)*^'(f,t)rff) ^ p (r) = 

= Atj) 1 {f) + £ w/iere A = 1 {'signal'), 5 = {'noise') {11). 

In eq. (10) and eq. (fl) we had to choose such an "input" ^/' that is more similar to ip 1 , for 
example, than to any other ip k , k 7^ I. At the same time, the "input" should be almost 
orthogonal to all the other if) k , k 7^ f. In this case, ^ converges to the quantum "pattern- 
qua-attractor" if) 1 , as it is shown in the last row of eq. (10) and in the last row of eq. (11). 
Thus, the memory pattern if) 1 is recalled (measured). If the condition, well known from the 
Hopfield model simulations, that "input" must be similar to one stored pattern (at least 
more than to other stored patterns) is not satisfied, then there is no single-pattern recall. 



5. DISCUSSION 

The system of quantum equations (8) and (9) is similar, according to their mathematical 
structure and coupling, to the system of neural- net equations (2) and (3). Because we are 
certain that the neural system (2) and (3) realizes efficient information processing, we have 
taken the similar system of equations from the quantum formalism in order to discover 
quantum Hopfield-like associative information dynamics. 
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There is a difference between the neural "algorithm" (2) — (5) and the quantum "algo- 
rithm" (8) — (11): Neural variables like q, v k and J in equations (2) — (5) are real- valued, but 
quantum variables like ip k and G are complex- valued. Important implications of this fact 
are discussed in detail in Perus (1996, 1997). 

Anyway, (quantum) holography shows (Abouraddy et al, 2001; Psaltis et al, 1990, 
1995) that the quantum neural-net-like information processing outlined here is realizable. 
Moreover, it seems that neural networks and quantum networks cannot necessarily be treated 
as complex systems with similar, but independent, collective dynamics. There are strong 
indications (Pribram, 1991, 1993) that biological neural networks essentially cooperate with 
quantum networks in the brain. Mediators are probably synapto-dendritic and microtubular 
nets. All these networks constitute a sort of fractal-like multi-level information processing 
(Perus, 1996, 1997). The wave-function collapse (a quantum sort of pattern recognition 
- remember eq. (10)) can be triggered by the system's interaction with environment (see 
Zurek, 1991; Brune et al, 1996). It seems that, in the brain, neural networks sensing the 
environment trigger the wave-function collapse and thus transform the quantum complex- 
valued, probabilistic dynamics into the neural (classical) real-valued, deterministic dynamics 
(Perus, 1996, 1997; Perus and Dey, 2000). A consequence of the wave-function collapse is 
that the quantum network becomes more neural- net- like, e.g. the observable "activities of a 
network of quantum points ('neurons')" are real-valued. 

It is true that holographic (Sutherland, 1991) and other oscillatory neural networks (e.g., 
Baird, 1991), too, do not realize the deep essence of quantum dynamics, i.e. the EPR- 
manifested non-local interconnectedness and indivisibility, called entanglement. But these 
features are broken and dynamics is thus discretized during quantum measurements. The 
implicit parallel-distributed quantum dynamics is useful for computation, but it has to be 
collapsed during the readout (or memory recall) process in order to obtain results of com- 
putation. These essential quantum features, manifested in the complex-valued formalism, 
could be harnessed or partly eliminated in order to realize neural-net-like information pro- 
cessing. Although it is useful to harness quantum superpositional multiplicity for compu- 
tational purposes (Steane, 1998; Scarani, 1998) as much as possible, it is practically un- 
avoidable to collapse the quantum wholeness during the readout (measurement) of results. 
For this, neuro-quantum (classical-quantum) cooperation, as manifested in the collapse- 
readout, seems useful for the brain as well as for hypothetical neuro-quantum computers 
(Kak, 1995). The advantages of quantum information dynamics, i.e. miniaturization, speed, 
computational and memory capacity, are preserved in that case. 

Detailed technical (or biological) realization of encoding of information into eigenfunc- 
tions ip k and the readout of results of quantum pattern-reconstruction is still an open and 
advancing field of research. For example, encoding and decoding (readout) methods using 
laser or NMR devices, developed for quantum computers (Ahn et al, 2000; Weinacht et 
al, 1999; Berman et al, 1998; Jones et al, 2000; Cirac and Zoller, 1995), could partially 
be used. There are numerous complex systems which are candidates for implementation of 
collective computation which "follows algorithms" similar to the one described here (Perus, 
1996, 1997; Pribram, 1991, 1993). 

A fundamental quantum information processing "algorithm" (8) — (11) was presented. It 
was constructed following the Hopfield and holographic neural network models which pro- 
cess information efficiently as tested by numerous computer simulations (e.g., Perus and 
Ecimovic, 1998; Amit, 1989; Sutherland, 1991). It was shown how can the Hopfield-like 
associative information processing and content-addressable memory, in principle, be realized 
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in "natural" quantum systems, i.e. without need for special devices, except for encoding 
and decoding. This has important consequences for foundations of physics and informat- 
ics as well as for cognitive neuroscience. One of many possible applications, i.e. quantum 
pattern- recognition, is presented at: quant-ph/0303092. Concrete possibilities of quantum 
implementation are also discussed there. 
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